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[57] ABSTRACT 

An ^paratus, for use in a motion-compensated video signal 
encoder, for detennining a predicted current frame based on 
a current and a previous frame, comprises: a feature point 
motion vector(M V) detector for detecting a first set of MVs 
for feature points; an edge point MV detector for, in each of 
the edges, detecting one or two neighboring feature points 
for each of edge points, and detennining a second set of 
MVs for the edge points; a quasi-point detector for detecting 
quasi-feature points and a third set of MVs therefor, and 
detecting quasi-edge points and a fourth set of MVs therefor, 
a non-quasi-point MV detector for detecting a fifth set of 
MVs for all non-quasi-points, each of the fifth set of MVs 
bemg determined by averaging th& MVs of one or more 
neighboring quasi-feature points for each of the non-quasi- 
points; an arrangement block for arranging the third, the 
fourth and the fifth sets of MVs to determine a group of MVs 
for all of the pixels in the current frame; and a motion 
conqiensator for providing a pixel value from the previous 
frame based on the position data of each pixel in the current 
frame and a MV thereof. 

3 Claims, 3 Drawing Sheets 
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IMAGE PROCESSING APPARATUS USING A tion of pixel values and has the ability to easily handle scale 

PIXEL-BY-PIXEL MOTION ESTIMATION changes (e.g., zooming, movement perpendicular to the 

BASED ON FEATURE POINTS image plane). However, in tiie pixel-by-pixel approach, 

since a motion vector is d^ennined at each and every pixel, 

FIELD OF THE INVENTION 5 it is virtually inqwssible to transmit all of the motion vector 

data to a receiver. 

The present invention relates to an apparatus for encoding ^ ^ 

a video signal; and, more particularly, to an apparatus for , ^ techniques mtroduced to amehoiate the prol^ 

encoding a video signal using a pixel-by-pixel motion of dcahng with Ac surplus or sup^ 

estimation based on feature points. , ^ resultmg from the pixel-by-pixel approach is a feature 

^0 point-based motion estimation method. 

DESOyOPTION OF THE PRIOR ART In the feature point-based motion estimation tedmique, 

motion vectors for a set of selected pixels, i.e., feature 

As IS weU known, transmission of digitized video signals ^^^^ ^ transmitted to a receiver, wherein each of the 

can deliver video images of a much higher quality than the feature points is defined as a pbccl capable of representing its 

transmission of analogjdgnals. When an image signal com- is neighboring pixels so that motion vectors for non-feature 

pnsmg a sequence of image "frames" is expressed in a ^^^^ ^an be recovered or ^oximated from those of the 

digital form, a substantial amount of data is generated for feature points at the receiver. 

transmission, especially in the case of a high definition , j u-uj*-^. ^ ^ ^* ^ ^ 

television systcTsinee. however, the available ftequency ^ ^ which adopts the motion wtonation based 

bandwidthof aconventionaltransmissionchannelislkmtei 20 <>" ^^}>^^ P?*'^^' disclosed in a ccpenAng cominpnly 

in order to transmit the substantial amounts of digital data J^f I"' -l^"' V^^^ 

through the limited channel bandwidth, it is ineWtable to ^e*od«dAppa«tus for En«,dmg a Videos 

comi^ess or reduce the volume of the transmission data. P^^^-by-Pif Mc^on ^Mm^on , a number of feature 

AmSng various video compression techniques, the soHUilled ^""^ "t^' **'%P«^? contamed m toe 

hybrid coding tedmiqurwhich combines temporal and 25 l»e^aous frame. Then^ a first set rf^^ 

spatial compression toques together with a^tistical "^f^ determined, wherem each of the 

coding technique, is known to be most effective. motion vectors represents a spabal displacement between 

, , ^ ^ ^. , . one feature point m the previous frame and a corresponding 

Most hybrid ^g techmques employ a motion com- j^gjching point i.e., a most similar pixel, in the current 

pcnsated DPai(differential pulse code modulation), tw<^ ^^^^ 

dune^ional DCr(discrete^^^^^ quantizafaon ^0 ^ q^^i.^^^ure point lUereafter, a second set of motion 

of DCT coeffiaents andVLC(vanablc length codmg). Hie sectors for aU of the pixels contained in the current frame is 

motion compensated pPOI is a process of de^mining the determined by using said first set of motion vectors. That is, 

movement of an object between a current frame and a onepartof the second set of motion vectors for quasi-feature 

previous frame and Fechctmg^ points is first determined by converting each of the first set 

to the motion flow of the object to produce a differenUal ^^^^^ rej^^aining part of the second set 

si^al representing &e diff^enc^ between the current frame ^f motion vectors for non-quasi-feature points is detennined 

and Its prediction T^ described, for example, m ^y averaging the motion vectors for the quasi-feature points 

StaffanEn^on, Fixed and Adaptive Predictors for Hybnd ^ ^ predetermined size of circular 

Predictive/Transform Coding", IEEE Transactions on boundary 

CommunicaHons, COM-33, No. 12 (Dec, 1985); and in ^ e- 1 • • ^ * .i. ^ ^ . 

Ninomiya and Ohtsuka, "A Motion-Compensated Inter- remaming part of the second set of motion 

frameCodingSchemeforTelevisionPicmres",/E££ W- vect«s f or non-quaa-f^tiire pomts is determmed without 

actions on Communications, COiA-'^Q,l\o, 1 (Jan. 1982). employing any actual information rda^^ 

„ .,1 ,1 . ^ . J Tx,^, of an object It may not be able to accurately estimate the 

Specifically, m toe motion compensated DPCM, current ^^^^ ^^^rs for the non-quasi-featiire points, 
frame data is predicted from the correspondmg previous 

frame data based on an estimation of a motion between the SUMMARY OF THE INVENTION 
current and the previous frames. Sudi estimated motion may 

be described in terms of two dimensional motion vectors ^ is, therefore, a primary object of the invention to 

representing the displacement of pixels between the previ- provide an inqiroved video signal encoding apparatus using 

ous and the current fi^es. ^ a pixel-by-pixel motion estimation based on feature points, 

There have been two basic approaches to estimate the ^^^^ accurately estimating the motion vectors 

motion cr displacement of pixels of an object one is a non-quasi-featiire points through the use of edge infor- 

block-by-block estimation; and the other is a pixel-by-pixd niation. 

approach. In accordance with the invention, there is provided an 

In the block-by-block motion estimation, a block in the inqiroved apparatiis, for use in a motion-con^sated video 

current frame is con^ared with blocks in its previous frame encoder, for determining a predicted current firiame 

untU a best match is determined. From this, an interframe ^^^^ ^ current frame and a previous frame of a digital 

displacement vector (which indicates how much the block of ^^"^ conpising: 

pixels has moved between the frames) for the whole block «> , ^ ®^Se detector for detecting edge points representative 

can be estimated. However, in the block-by-block motion of pixels forming edges of an image in the previous 

estimation, poor estimates may result if all pixels in the frame; 

block do not move in a same way, to thereby decrease the a feature point selector for sele<^g a number of pixels 

overall coding efSdency. among the edge points in the previous frame as feature 

In case of the pixel-by-pixel estimation, on the other hand, 65 points; 

a displacement is determined for each and every pixel a feature point motion vector detector for detecting a first 

Accordingly, this technique allows a more accurate estima- set of motion vectors for the feature points, each of the 
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first set of motion vectors rqpresentiDg a spatial dis- from a second firame memory 124 are processed to predict 

placement between one of the feature points and a most the current firame by using feature points to generate a 

similar pixel thereto in the current frame; predicted current frame signal onto a line L30 and a set of 

an edge point motion vector detector for, in each of the motion vectors for the feature points onto a line L20, 

edges, detecting one or two neighboring feature points 5 respectively. Details of the current firame prediction block 

for each of the non-selected edge points, and detecting 150 will be described with reference to FIG. 2. 

a second set of motion vectors for the non-selected The predicted current firame signal on the line L30 is 

edge points, each of the second set of motion vectors subtracted from the current frame signal on the line L9 at the 

being determined by averaging the motion vectors of subtracter 102, and the resultant data, Le., an error signal 

the one or two nei^boring feature points; denoting differential pixel values between the current and 

a quasi-point selector for detecting quasi-feature points in ^® predicted current frame signals, is dispatched to an 

the current frame corresponding to the feature points image signal encoda: 105, wherein the error signal is 

and a third set of motion vectors for the quasi-feature encoded into a set of quantized transform coef&cients by 

points based on each of the first set of motion vectors using, e.g., a DCT and any of the known quantization 

and detecting quasi-edge points in the current frame methods. Thereafter, the quantized transform coefficients are 

based on each of the second set of motion vectors and transmitted to an entropy coder. 107 and an image signal 

a fourth set of motion vectors for the quasi-edge points; decoder 113. At the entropy coder 107, the quantized trans- 

a non-quasi-point motion vector detector for detecting a coefficients from the image signal encoder 105 and the 

fifth set of motion vectors for all non-quasi-edge and "^^^^'^ Y^^^^^ traiismitted through the hne KZO from the 

non-quasi-feature points, each of the fifth set of motion prediction block 150 are coded together by 

vectors being determined by averaging the motion "^"^g' ^-S*' ^ ^^^^^ ^^^^ technique. Thereafter, 

vectors of one or more neighboring quasi-feature points ^^g?^ P'^^j^^ ^ transmitter(not shown) for 

for each of the non-quasi-edge and non-quasi-feature transmission thereof. 

points, wherein the one or more nei^boring quasi- „ In the meantime, the image signal decoder 113 converts 

feature points are placed within a circular boundary quantized transform coefficients from the image signal 

having a combined radius of the distance from eadi of encodo" 105 back to a reconstructed error signal by enq)loy- 

the non-quasi-edge and non-quasi-feature points to a ing an inverse quantization and an inverse discrete cosine 

nearest quasi-feature point corresponding thereto and a transform The reconstructed error signal from the image 

predetermined distance; signal decoder 113 and the predicted current frame signal on 

an anangement block for arranging the third, tiie fourth ^ prediction block 150 are 

and tiie fifth sets of motion vectors to determine a group combined at an adder 115 to tii^eby provide a reconstructed 

of motion vectors for aU of the pixels in the current ^^^^^ ^^^^ stored as a previous frame in the 

frame; and ^^^^^^ memory 124. 

a motion compensator for providing a pixel value from 35 I^efecring now to FIG. 2, Uiere arc illustrated details of the 

the previous frame based on tiie position data of each cuirent frame prediction block 150 shown in FIG. 1. As 

pixel in tiie current frame and a motion vector tiiereof, ^ ^ P^^^^^^^s frame signal on the line L12 is 

to thereby determine the predicted current frame. provided to an edge detector 209 and a feature point motion 

vector detector 212, respectively. At tiie edge detector 209, 

BRIEF DESCRJFnON OF THE DRAWINGS 40 ^ ^^^^ of edge points representative of pixels forming 

edges of an image in the previous frame are detected through 

The above and other objects and features of the present a conventional edge detection technique. The edge points in 

invention will become apparent from the following descrip- tiie previous frame are provided on a line L13 to a feature 

tion of preferred embodiments when taken in conjunction point detector 210, an edge point motion vector detector 214 

with the accompanying drawings, in which: and a quasi-point detector 218. 

FIG. 1 is an image signal encoding apparatus having a At tiie feature point detector 210, a plurality of feature 

current frame prediction block of the present invention; points arc detected among the edge points from the edge 

FIG. 2 shows a detailed block diagram of the current detector 209. In a preferred embodiment of the present 

frame prediction block of FIG. 1; invention, the feature points are selected at the intersection 

FIG. 3 describes a method for determining the motion 50 points of grid points and the edge points. The detection 

vectors for edge points excluding feature points on each of nietiiod is disclosed in a copending commonly owned 

tiie edges; and application, U.S. Ser. No. 08/367,520, entitied "Method and 

FIG. 4 represents a method for detecting the motion ^^fT^ for Encoding a \ldeo Signal Using Rxel-by- 

vectors for non-quasi-points. EstimaUon", ^^^ch is mcorporated herem by 

55 reference in its entirely. The feature points from the feature 

DETAILED DESCRIFnON OF THE ^^^^ detector 210 are provided on a line L14 to the feature 

PREFERRED EMBODIMENTS P^^^ motion vector detector 212 and the edge point motion 

vector detector 214. 

HG. 1 describes a preferred embodiment of tiie inventive At tiie feature point motion vector detector 212, a first set 
image signal encoding apparatus. As shown in FIG. 1, a of motion vectors for the feature points is detected. Each of 
current fi^e signal of an input video signal is stored in a the first set of motion vectors represents a spatial displace- 
first frame memory 100 which is connected to a subtractor nient between a feature point in tiie previous frame and a 
102 tiirough a line L9 and to a current frame prediction block most sirmlar pixel tiiereto in tiie cuirent frame called as a 
150 tiirough a line LIO. quasi-feature point. To detect a motion vector between a 

In the current frame prediction block 150, a cuirent frame 65 feature point and a quasi-feature point, there is used a block 

signal on the line LIO retrieved from the first frame memory matching algorithm That is, when a feature point is received 

100 and a reconstructed previous frame signal on a line L12 from the feature point detector 210. a feature point block 
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having the feature point at the ccntex thereof, e.g.. 5x5 pixels use of an appropiiatB filteiing window. For instance, if the 

of the previous frame, is retrieved via the line L12 from the first median filter 216 has a 3x3 filtering window, the first 

second frame memory 124(shown in FIG. 1). Thercafta, fiie median filter 216 at a given non^sdected edge point, e.g. 

motion vector for the feature point block is determined after eP2, as shown in FIG. 3, averages seven motion vectors for 

a similarity calculation between the feature point block and 5 edge points, which are included in a filtering window FW, by 

each of a pluraHty of equal-sized candidate blocks included multq)lying prcdetennined filter coefladents thereto; and 

in a generally larger search region, e.g., 10x10 pixels, of the assigns the averaged value as a filtered motion vector of the 

current frame retrieved from the first frame memory 100 non-selected edge point EP2. The filtering operation on the 

(shown in HG. 1). The detennined motion vector for the second set of motion vectors is continued until an error vahie 

feature point block is assigned as the motion vector of the between a current averaged vahie and a previous average 

feature point contained in that feature point block. y^lue or an original value is not greater than a predeteimined 

After detecting the motion vectors f ot all of the feature value. Each of the filtered motion vectors for the second set 

points, the first set of motion vectors is provided to the edge is provided from the first median filter 216 to the quasi-point 

point motion vector detector 214, a first median filter 216. a detector 218. 

quasi-point detector 218 and the entropy coder 107(shown in 15 Based on the edge point information from the edge 

HG. 1) via the line L20. detectOT 209, the first set of motion vectors from the feature 

In the meantime, based on the edge points, the feature point motion vector detector 212 and the second set of 

points and the first set of motion vectors for the feature filtered motion vectors from the first median filter 216, the 

points, the edge point motion vectOT detector 214 detects a quasi-point detector 218 determines quasi-feature points and 

second set of motion vectors for the edge points exduding 20 quasi-edge points in the current frame by shifting each of the 

the feature points. The edge points excluding the feature feature points and the edge points by the motion vector 

points, hereinafter, are called non-selected edge points. thereof; and provides a third set of motion vectors for the 

Referring to FIG. 3 at this time, there is illustrated a method quasi-feature points and a fourth set of motion vectors for 

of detecting a second set of motion vectors for the non- the quasi-edge points. Since eadi of the first and the second 

selected edge points lying on an exen^)lary edge. As shown 25 sets of motion vectors represents the displacement between 

in FIG. 3, Acre are a number of open and filled-in dosed a pixel point in the current frame shifted from its corre- 

drcles forming the exemplary edge. The filled-in drdes spending pixd point in the previous frame, the magnitude of 

represent the feature points and the open drdes illustrate the eadi of the motion vectors in fiie third and the fourth sets is 

non-sdected edge points. In order to detect each of fee identical to that of the corresponding motion vector in the 

second set of motion vectws, first, one or two ndghbOTing 30 first and second sets, except that the directions of the two 

feature points are detected for each of the non-selected edge motion vectors arc opposite each other. The third and the 

points. In general, a non-sdected edge point, e.g., EPl, has fourth sets of motion vectors from the quad-point detector 

two neighboring feature points, e.g., FPl and FP2. However, 218 are provided via a line L16 to a non-quasi-point motion 

if the edge is of open loop and a non-sdected edge point lies vector d<to;tor 220, a second median filter 222 and an 

at an end portion fiiereof, the non-selected edge point e.g., 35 arrangement block 224. 

EP3, has only one ndghboring feature point, e.g., FP2. And The non-quasi-point motion vector d^ector 220 detects a 
then, eadi of the second set of motion vectors is detected by fifth set of motion vectors for aE non-quasi-edge and non- 
averaging the motion vectors for ttie one or two ndghboring quasi-feature points. The non-quasi-edge and non-quasi- 
feature points corresponding to eadi of the non-sdected feature points represent all of the remaining pixd points in 
edge points. For instance, the motion vector for the non- 40 the current firame exduding both the quasi-edge points and 
selected edge point EPl is detomined by averaging the the quasi-feature points, and, hereinafter, each of them shall 
motion vectors fa- fee two ndghboring feature points FPl be called as "a non-quasi^omt". Eadi of the fifth set of 
and FP2. The motion vector (MV^^ ^^y)£Pi for the non- motion vectors for non-quasi-points is determined by avcr- 
selected edge point EPl may be determined as: aging the motion vectors of one or more neighboring quasi- 

45 feature points for each of the non-quasi-pcints, wherein the 

(AfV^ mVj,)epi = Eq. (1) qj j^qj^ neighboring quasi-feature points are placed 

^ ^ within a circular boundary having a combined radius of a 

~3r •♦'"^ (*^^ AfVy)fw variable distance from each of the non-quasi-points to a 

j I JL" nearest quasi-feature point corresponding thereto and a 

'^^ ^ 50 predetermined size of a fixed distance. 

For instance, as shown in FIG. 4, a number of quasi- 
wherdn dl and d2 arc the distances from the non-sdected feature points, e.g., QFl to QF6, is irregularly distributed in 
edge point EPl to the feature points FPl and FP2, respec- the entire current frame. A motion vector of a given non- 
tively; and (MV^ MVy)^^^ and (MV„ MVy are motion quasi-point, Le., a star marked point NQP, is determined by 
vectors for the feature points FPl and FP2 with MV, and 55 averaging the motion vectors fox the quasi-feature points, 
MVy being the horizontal and vertical components of a e.g., QF3 and QF4, which are placed within a drde bound- 
motion vector. ary having a radius of "da+dr", wherem "da" is the distance 

In case that a given non-sdected edge point, e.g.,EP3, has to tiie nearest quasi-feature point from the star marked 

only one ndgjib«ing feature point, e.g. FP2, the motion non-quasi point, and "dr^ is a predetermined expanded 

vector for the non-sdected edge point EP3 is determined by 60 radius for indu<Ung other quasi-feature points to be used in 

the feature point FP2 only. That is, the value of the motion the motion vector calculation. H tiie nearest quasi-feature 

vector for EP3 is identicd to that of the motion vector fox point is QF4, and the quasi-feature point QF3 is located 

FP2. The second set of motion vectors for the non-sdected within the boundary of •*da+<lr^. the motion vector (MV 

edge points is sent to the first median filter 216. MVy)jv^or the non-quasi-point NQP may be calculated as: 

At the first median filter 216. a median filtering operation 65 

is performed on each of the second set of motion vectcffs fed (MV^ A^v,W = Eq. (2) 
from the edge point motion vector detector 214 through the 
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1 

d3 



wherein d3 and d4 aie distances from the non-quasi-poiat 
NQPto the quasi-fcature points QF3 and QF4, respectively; 
and, (MV^ ^'^y)QF3 and (MV^ '^y)QF4 ^ respective 
motion vectors for the quasi-feature points QF3 and QF4; lO 
and MVjp and MV^ave the same meanings as in Eq. (1), The 
fifth set of motion vectors for the non-quasi-points is pro- 
vided to a second median filter 222. 

At the second median filter 222. a median filtering opera- 
tion is performed on each of the fifth set of motion vectors 15 
fed firom the non-quasi-point motion vector detector 220 
through the use of an appropriate filtering window. The 
filtering operation of the second median filter 222 is iden- 
tical to that of the first median filter 216. The filtered motion 
vectors for the non-quasi-points arc provided to the arrange- 
ment block 224. 

The arrangement block 224 arranges the third set of 
motion vectors for the quasi-feature points » the filtered 
motion vectors for the quasi-edge points and the filtered 
motion vectors for the non-quasi-points in order to deter- 
mine a group of motion vectors for all of flic pixels in the ^ 
current frame. The group of motion vectors for all of the 
pixels in the current frame is sent to a motion compensator 
226. 

The motion conq)ensator 226 provides a pixel value from 
the previous frame stored in the second frame meniory 124 30 
(shown in FIG. 1) based on the position data of each pixel 
in the current frame and a motion vector thereof, to thereby 
determine the predicted current frame. 

While the present invention has been shown and 
described with respect to the particular embodiments, it will 35 
be apparent to those skilled in the art that many changes and 
modifications may be made without departing from the spirit 
and scope of the invention as defined in the appended 
claims. 

What is claimed is: 40 
1. An apparatus, for use in a motion-con^ensated video 
signal encoder, for determining a predicted current frame 
based on a current frame and a previous frame of a digital 
video signal. conq>rising: 
means for detecting edge points representative of pixels 

forming edges of an image in the previous frame; 
means for selecting a number of pixels among the edge 
points in the previous frame as feature points; 



means for detecting a first set of motion vectors for the 
feature points, each of the first set of motion vectors 
representing a spatial displacement between one of the 
feature points and a most similar pixel thereto in the 
current firame; 

means for, in each of the edges, deteOing one or two 
neighboring feature points for each of the non-selected 
edge points, and detecting a second set of motion 
vectors for the non-selected edge points, each of the 
second set of motion vectors being determined by 
averaging the motion vectors of said one or two neigh- 
boring feature points; 

means for detecting quasi-feature points in the current 
frame corresponcting to the feature points and a third set 
of motion vectors for the quasi-feature points based on 
each of the first set of motion vectors and detecting 
quasi-edge points in the current frame based on each of 
the second set of motion vectors and a fourth set of 
motion vectors for the quasi-edge points; 

means for detecting a fifth set of motion vectors for all 
non-quasi-edge and non-quasi-feature points, each of 
the fifth set of motion vectors being determined by 
averaging the motion vectors of one or more neighbor- 
ing quasi-feature points for each of the non-quasi-edge 
and non-quasi-feature points, wherein said one or more 
neighboring quasi-feature points are placed within a 
circular boundary having a combined radius of the 
distance from each of the non-quasi-edge and non- 
quasi-feature points to a nearest quasi-feature point 
corresponding thereto and a predetermined distance; 

means for arranging the third, the fourth and the fifth sets 
of motion vectors to determine a group of motion 
vectors for all of the pixels in tfie current frame; and 

means for providing a pixel value from the previous fr^me 
based on the position data of each pixel in the current 
frame and a motion vector thereof, to thereby determine 
the predicted current frame. 

2. The apparatus in accordance with daim 1, which 
further comprises means for filtering flie second set of 
motion vectors. 

3. The apparatus in accordance with daim 2, which 
further comprises means for filtering the fifth set of motion 
vectors. 
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